


Institutional Archive of the Naval Postgraduate School 





Calhoun: The NPS Institutional Archive 
DSpace Repository 


Theses and Dissertations 1. Thesis and Dissertation Collection, all items 


1970 


A linear programming method for detecting 
negative circuits with special application to 
the assignment problem 


Dennis, Robert Vaughn 


Monterey, California; Naval Postgraduate School 
http://ndl.handle.net/10945/15068 


This publication is a work of the U.S. Government as defined in Title 17, United 
States Code, Section 101. Copyright protection is not available for this work in the 
United States. 


Downloaded from NPS Archive: Calhoun 


Calhoun is the Naval Postgraduate School's public access digital repository for 
(8 DUDLEY research materials and institutional publications created by the NPS community. 
«ist sae Calhoun is named for Professor of Mathematics Guy K. Calhoun, NPS'‘s first 


INN KNOX appointed — and published -- scholarly author. 

| LIBRARY Dudley Knox Library / Naval Postgraduate School 

411 Dyer Road / 1 University Circle 
Monterey, California USA 93943 





http://www.nps.edu/library 








United States 
Naval Postgraduate School 





THESIS 


A LINEAR PROGRAMMING METHOD FOR 
DEtEer PE NGS NEGATIVE CiIRCULTS#yWath SeEerat 
APPLICATION TO THE ASSIGNMENT PROBLEM 


by 


Robert Vaughn Dennis 





March 1970 


Approved for public release; distribution unlimcted. 


$ 





A Linear Programming Method for Detecting 
Nepative Circuits with opecraie ppl weaciom 
EO the —Assionmente. & roowen 


by 


Robert Vaughn Dennis 
Lieutenant Colonel, United States Army 
5B. ow eLOulSTana octave UNnimvetsmry rs or 


Submitted in partial fulfillment of the 
equine nelle sesOg sinc "Gc Gn cle mon 


MASTER OF SCIENCE IN OPERATIONS RESEARCH 


from the 


NAVAL POSTGRADUATE SCHOOL 
March 1970 


Thue D354 


Cy 





ABSTRACT 


A new method for detecting negative cycles in a graph is 
proposed. This method is based en the primal - dual 
relationships of a linear program formulated from an assign- 
ment problem type network. A computer program is developed 
for this new method to include the complete solution of the 


assignment problem. Results are given on program efilciene,, 
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Pee OBE Gin i 


A new method has been proposed by H. Greenberg for the 
detection of negative cycles in an assignment type problem. 
The objective of this thesis was to develop a computer pro- 
gram for this new method and to measure the efficiency 


thereof relative to execution time. 





Ii DESCRIPTION OR De Mian e p 


A. INTRODUCTION 

Suppose there exists a network with vertices V = AS Sens. eeeellae 
directed edges E = {(i,j)e V X V}, a non-negative integral 
valued function k giving the maximum allowable flow k. . over 
every edge, and a non-negative cost function a giving the cost 
a.. associated with a unit of flow over any edge. A flow X 


1) 
of value v is an integral valued function on E satisfying: 


(1) 0 2% ¢ < Key? (ats 6. Ee 
(2) ; 
Z " = or 
ail (x5; Sag) =v,ie-l, 
= 0, 1 = 2, eae 
= -V, 1 =n 


Vertices 1 and n are, respectively, called the flow source 
and sink. 
The minimal cost flow problem is to find, among all flows 


X of value v, one which minimizes: 


3 X) = z vonage 
(8) GIGS nee 5 gas 


The assignment problem is to fill n jobs by as many men 
guesleast total cost where 455 represents the cost of using 
met (4 —- 1... Mein gOb 7} “(jihaametad, ., en). “Because 
of this bipartite form the problem can be thought of as a 
Special minimal cost flow problem. 


Now suppose a flow has been found satisfying (1) and (2), 


and for the assignment problem this corresponds to finding a 





flow of value v = n and Nae values by, say the “Least Cost 
Rule" given by Dantzig in [1] (p. 307). We then construct an 
associated network G(X), given by Klein [2], which has the 
same vertices as the original network and directed edges as 


follows: 


(4) WE COs ee eg ee and ae 0, 


Ca a) ales RS eae. 
meh revised Capacities: 


(US) kek see = ke ee oc and oer 
ij Tel eemeaby ij cy Val 
| CEP <n gs bi 6 cr en OM 
1) 1) 1) 


and with revised edge costs: 


(6) a a5 j = aij: ee Xi < 5 and an = 0, 
Ae = apt eee eae 
Ji 1J iJ 


These revised edge costs are simply those associated with 
meeneasing or cancelling the flow by one unit on these edges: 
the revised capacities indicate the extent to which this can 
be done. 

Now, use a result proved in Busacker and Saaty ([3], pp. 
Zsa-257). 

Theorem. X is a minimal cost flow if and only is there 
is no directed cycle C in G(X) such that the sum of the costs 
around C's edges are negative. ((herciinic ere cme Werle mss ea 
sequence of distinct directed edges of the form 
Gr ty) (i1,,15,)°°°G 


iQ) (i »i)} involving distinct 


Pp q 


Wertuices.) 








An immediate consequence of this theorem is that a test 
of the optimality of the flow X is at hand if G(X) can be 
checked for the existence of a negative cost directed cycle. 
Further, if such a cycle is found, an improved flow is ob- 
tained by sending a positive unit flow around this cycle. 
Such a flow alteration obviously leads to a lower total cost 


and also leaves the flow value v unchanged. 


B. THE NEW METHOD 

Several methods exist for locating negative cost directed 
cycles (see Klein [2]). The new method nae to these. The 
idea. behind this method is to formulate a linear program 
from the network G(X) using the flow balance equations as 
eonstraints. A mathematical statement of this set of 
equations for the assignment problem is: 


(7) minimize: Z = )} Xiass, where E(X) is deter- 
(i,j)cE *4 +4 mined by the assignment, 


SUpiicer FOl 


> *5 ~ z a ie 0, 1=41, Nl, 

Deeley ie Gy oles 
Flow 
Balance Xiao Py = 0, jantl,@-2 28 

TAG SAE 2 (eae 
Rheguires ; z < Sa 
positive ee ree 1j- ”’ 
flow ae en 

en ee 
lj - 


Obviously, a feasible solution exists to this program. 


But, more importantly, if a negative circuit exists then the 





solution will be unbounded since -the sum of the Mas around 
the circuit will be negative and the flow around this circuit 
will be increased with the solution approaching minus infinity. 

The consequence of this is that we have at hand another 
method for detecting negative circuits by capitalizing on the 
theorem (see Hadley [4]) that an infeasible dual implies an 
unbounded primal when the primal has at least one feasible 
solution. Thus the dual of the above program (7) is solved 
through Phase I, only, of the Simplex Method to test for 
feasibility. If feasible, then the assignment is optimal. 
If the dual is infeasible, then the assignment is not optimal 
and a change of assignment is made. This process is repeated 
until a feasible dual and, hence, an optimal assignment is 
obtained. 

The formulation of the primal program is now illustrated 
with a two by two assignment problem example. The cost matrix 
for this example is (8): 


(8) 





where 1 = 1,2 denote the men and j = 3,4 denote the jobs, 
hereafter referred to as assignee and assigned nodes, 
Respectively. First, an initial assignment mus€ be obtained. 


say by the "Least-Cost Rule". Suppose this assignment is 


(j-i), 3-1, 4-2. Then the craph Gi) srepaesen tiie ener 


problem can be constructed (9). 


(9) 
a es a 
if 3 
D5 OS 474%14 
Z 4 
ee 
The flow balance equations are then (10): 
(10) 
Node 1: X14 = Xy3> 
Node 2: Xo2 = Xoq> 
Node 3: X13 = Xo 
Node 4: Xoq = X14° 


Peon Which 15 written the linear program (11): 


enim a te eT A313, eas 2s gee 


subject to: 


eg 2S =e 
x - x = 0 
Ne 24 ome 
X43 “Xo 2 = 0, Balance 
— Xyy Pou le oE 
X73 + Xyyq *X%oz + Xqq 21, Positive 
Flow 
> rere 
1j ao 





The dual to this program (11) is then solved through Phase I 


to test for optimality of the assignment. 


10 





III. PROGRAMMING THE ALGORITHM 


A. THE STANDARD FORMAT | 
thre dualy prose cane to (sp) mesma): 
(12) maximize Ve> 

Subject fo: 


Sih 3 : “ay 2; 
Vy “Vy < Ra 
Vee = Bere 
a. ide Seats 


which, after conversion to the standard form for solution 
ms (13): 

(13) maximize Veo 
subject to: 


mal aes Bier va id Fee 
Ml 4 22 ae 
V5 “Vz : 35 = Anz» 
Lo a A = Joe 


with slack variables $4 through Sy- Examining the array of 
coefficients, a standard format for any size problem can be 
detected. This format can be illustrated with a three by 
three problem annotated with general dimensions (14), where 

n denotes the number of assignee or assigned nodes (in this 
case n = 3), V5 (i=l: ,2n) the duals Varvapres. s,(jel,tton*) 


the slack variables, 98) 4 al JHE artificial variables added to 


iL 





(14) 


<p eS) > | = +A a 


Basie Ve Nee Ni WA NE S 4: Dae a Oe oie ol Constants 
Variables 1 2.3 4 Sele 2 5 4 eC ae ome 
S 1 | 





“Sq 1 -] 


obtain a basis, and W the infeasibility form, Examining the 
format in detail, it is noted that the first n columns derive 
from the flow balance constraints on the assignee nodes 
(numbered from 1 to n); the second n columns derive from the 
constraints on the assigned nodes (numbered from ntl to 2n); 


and the n2 


slack columns reflect the assignment. The slack 
columns reflect the assignment in that the rows in which the 
-l's appear indicate the assignment that has been made. If 
the rows in each group of n rows are numbered identically from 
n+l to 2n then the row number in which the -1l appears in the 
first group of n rows is the number of the node assigned to 
the first assignee node. Similarly, the remainder of the 


assignment can be determined. In this example (14), 5 is 


assigned to 1, 4 is assigned to 2, and 6 is assigned to 3. 


IW 





Of course, only n of these -l'S may appear. Moreover, the row 
number of a -l may not be duplicated between groups Since this 
would indicate a duplicate assignment. 


It is seen then that the only format change between dif- 
erent problems 2s yinethe slack scolunns sreiloe tt) memmenc 
assignment. This feature was exploited in programming the 
Simplex iterations by reducing the computer storage require- 
ment for this matrix to a single vector of dimensions n? by 
I. This vector records the assignment and its contents are 
scanned when format information is needed. It should also be 
moored that with this format the matrix of Coefficients 2s 
Wiamodular. Hence, for every iteration the coefficients 


Tare be + 1 or 0. 


Pee lLIERATIVE PROCEDURE USED 

The revised simplex method was used to perform the Phase 
I iterations because of the computational advantages. Exam- 
mene the standard format (14), we see that at least n 
iterations are required because of the -l's in the first n 
rows of the infeasibility form equation. To reduce compu- 
tational time the revised simplex method was modified to carry 
out these n iterations. The simplex multipliers were not used 
to find the candidate for the new basic variable. Instead, the 
first n variables were introduced into the basis sequentially. 
Subsequently, the standard revised simplex method was used. 

At this point it would be useful to illustrate the contents 
of the matrix used to perform the iterations. Again, this will 
be illustrated with the previous three by three problem, anno- 


tated with general dimensions (15). This matrix is denoted B 


13 
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iiecene computer program. In addition to containing the ain- 
verse of the basis and the simplex multipliers, where 8, 
denotes the artificial variable madea for the corresponding 
negative slack variable, the matrix contains an assignment 
column (ACOL) and a variable identification column (VCOL). 
The assignment column, with binary entries of 0 or 1 only, 
where 1's record the assignment (in this case the initial 
assignment is 1-5, 2-4, 3-6), is used as a memory device in 
performing the iterations and in printing the solution. The 
variable column records the variables in the basis and is up- 
dated after each iteration. The minus indicates an artificial 
variable. If a problem is infeasible, this column is scanned 


to determine which artificial variables remain in the basis. 
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This information is necessary in changing the assignment, 
which shall be described later. 

While the revised simplex method requires less computer 
storage than the standard simplex method, the storage require- 
ments for this method are, nonetheless, relatively large. For 
instance a 15 by 15 problem requires approximately 210,000 
bytes of storage. (228 X 227 = 51,756 storage locations for 
the matrix B + 675 storage locations for a computing ie caecaees 
and input/output requirements = 52,431 total X 4 bytes per 
iWeeadtion for single precision = 209,724 bytes.) But}; other 
meenods for detecting negative circuits require 4s much 


storage. 


tee INITIAL ASSIGNMENT 
Up to this point an initial assignment has been assumed, 

but the method for finding that assignment has not been 
described. The method selected was the "Least-Cost Rule" 
with steps as follows: 

1) The cost matrix is scanned to determine the lowest 
Sect, 1.e€., find eco tine | 

(ini) 

7yerIneSeOLuln ei and the FOWelsine When  tn1lS COS se 
appears constitutes the first assignment. That column and 
row is then ineligible for further assignment. 

3) Steps 1) and 2) are repeated for costs remaining 
in eligible rows and columns until all assignments have been 


made. 


15 





D. CHANGE OF ASSIGNMENT RULE 

Summarizing the procedure described thuseiay ras een 
initial assignment is determined. Next the dual problem to 
(7) is solved through Phase I of the simplex method. If the 
problem is feasible, then the initial assignment is optimal 
and the solution is printed. If the problem is not feasible 
then the initial assignment is not optimal and a change in 
assignment is required. 

The key to devising an assignment change rule is contained 
iemche artificial yectors remaining in the basis because they 
Hemiecce che infeasibility.  In’every column of the dase n? 
Seorumns in which an entry other than zero appears in the 
Pimelrt1Clal vector, the sign 15 changed of the * loimeathae 
column of the basic format (14). Thus, the artificial vectors 
remaining in the basis are identified and constructed from the 
miverse and the procedure just described is performed for cach 
Smtenese Vectors sequentially. The efficacy of this rulewic 
evaluated in the following section. It should be noted that 
fmec this procedure does not Change the coeciricients of any 
variable in the basis, the inverse for the last tableau remains 
fom. hererore, 1t 1S not necessary to cycle back to thie 
initial tableau. Rather, after the assignment has been recorded 
in the memory device (ACOL), the simplex iterations can continue 
trom the last tableau. 

A good illustration of application of the assignment rule 
is problem 5 (see Appendix B), a five by five problem. After 


nine iterations the program was found to be infeasible and two 
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artificial vectors remained in the basis (-Sj¢ and “Sz4). 

The vectors shown on the following page trace the change in 
assignment from initial contents of ACOL tem tina iecomeciie: 

of ACOL. For ease in recognizing the assimonments the vyeceou. 
have been partitioned by n (n = 5). Recall that the entries 
oeeACOL are binary (0,1) andwthat an entryesother than 091m 
Micwartiidcial vector ‘flip eilops sine COmmesponda mos oor 


entry. 
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Twenty problems, ranging in size from tour by e-ouuete 
iS. Dye > Wen Cus 1 Cem el mc entires comprising the Cost mat iie. 
were the integers one through nine, selected randomly (see 
Appendix B). The method yielded an optimal solution in each 
case. The execution times ranged from 0.7 seconds for a 
mour Dy £0ur to 56 seconds for a 15 by 15 (see Appendix AR 
In three instances the initial solution was optimal and, 
hence, an assignment change was not required. But, ene 
remaining 17 problems an assignment change was required and 
in every case the change rule produced the optimal assignment 
Pecne Lirst attempt. With respect to the number of viter- 
melons required to detect a negative Circuit the range was 
meom 7 to 35. And, in all cases the number of iterations 


required was less than the number equations involved. 
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APPENDIX B 


PROBLEMS AND SOLUTIONS 
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